AD-A274  654 


V 


PARAMETER  ESTIMATION  FOR  ARMA  MODELS 
WITH  INFINITE  VARIANCE  INNOVATIONS 


0 


by 


DTIC 

ELECTE 
JAN  12 1994 


Thomas  Mikoscb^,  Tamar  Gadrich,  Claudia  Kluppelberg,  and  Robert  J.  Adler’ 
Victoria  University  Wellington,  Technion  Haifa, 
i  ETH  Zurich,  Technion  Haifa. 


■ 

r.-S; 


Abstract 


•V 

cor 


insider  a  standard  ARMA  process  of  the  form  =  Q{B)Zu  where  the 

••••  innovations  Zt  belong  to  the  domain  of  attraction  of  a  stable  law’,  so  that  neither 
the  Zt  nor  the  Xt  have  a  finite  variance.  Our  aim  is  to  estimate  the  coefficients  of 
4  and  0.  Since  maximum  likelihood  estimation  is  not  a  viable  possibility  (due  to 
the  unknown  form  of  the  marginal  density  of  the  innovation  sequence)  we  adopt  the 
so-called  “Whittle  estimator”,  based  on  the  sample  periodogram  of  the  X  sequence. 
Despite  the  fact  that  the  periodogram  does  not,  o  priori,  seem  like  a  logical  object 
to  study  in  this  non-£’  situation,  we  show  that  our  estimators  are  consistent,  obtain 
their  asymptotic  distributions,  and  show  that  they  converge  to  the  true  v^Jues  faster 
than  in  the  usual  case. 
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1.  Introduction 

This  paper  considers  two  closely  related,  but  distinct,  subjects.  We  commence 
with  the  discrete  moving  average  process 

00 

i=-oo 

where  ^  ^  sequence  of  iid  random  variables  (r.v.’s)  having  not  nec¬ 

essarily  a  finite  variance.  Two  preceding  papers  by  Kliippelberg  and  Mikosch 
(1991),  (1992),  studied  the  asymptotic  behaviour  of  periodogram-type  estima¬ 
tors  for  the  process  (.^t)t£2  ui>(icr  the  condition  that  Zi  is  in  the  domain  of 
normal  attraction  of  an  a-stable  law  for  some  a  €  (0,2).  In  Kliippelberg  and 
Mikosch  (1992)  it  was  shown  that  the  normalized  periodogram 

n  ^  j  n 

/n.x(A)=  /H^t,  -»<A<ir, 

tsl  /  t=l 

converges  in  distribution  to 

|t^(A)p  a»(A)  +  ^»(A) 

oo 

where  V’(A)  =  V’j  is  the  transfer  function,  V*).  and  the 

;=-oo 

vector  (a(A),fi(A),7^)  has  a  mixed  stable  distribut’on  such  that  (a(A),/9(A)) 
are  jointly  a-stable  and  7^  is  positive  a/2-stsble.  Furthermore,  the  vector 
of  different  periodogram  ordinates  (/n,x(Ai))  converges  weakly,  and 

the  components  of  the  limit  vector  have  exponentially  fast  decreasing  taik  and 
are  uncorrelated.  Smoothed  versions  of  the  normalized  periodogram  were  also 
studied,  and  their  weak  convergence  to  the  normalized  power  transfer  function 
|^(A)p/V'^  established. 

In  this  paper  we  weaken  the  above  assumptions  on  Zi  considerably:  we  only 
require  that  E \Zif  <  00  for  some  d>  0  and  that  Zf]  satisfies  some 

\«=i  /„>i 

tightness  condition.  Under  such  general  conditions  one  cannot  expect  to  de¬ 
rive  distributional  limits  for  /n,x(A);  but  we  prove  wertk  convergence  for  the 
smoothed  normalized  periodogram  to  |^(A)|^/ for  a  large  class  of  smooth¬ 
ing  filters  (Section  3).  In  Section  4  we  obtain  under  the  same  mild  condi- 
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tions  on  the  noiae  variables  weak  convergence  of  the  sample  autocorrelations 
53  -^t+k  Xt  /  ^  io  53  yl)j  /  for  fc  e  Af. 

«=1  /  lasl  js:-eo  j 

In  Section  5  we  turn  to  the  second  and  main  subject  of  this  paper:  parameter 
estimation  for  an  ARMA(p,  f  )-proces8  of  the  form 

Xt  ~  'fii  Xt~i  —  —  ~  Xf^p  —  Zt  Bi  Zt—i  + . . .  +  j  Xt-f 

for  fixed,  known  values  of  p  and  q.  Adapting  an  idea  of  Whittle  (1953)  we  con¬ 
struct  a  weakly  consistent  estimator  A,  of  the  parameter  vector  ^  =  (^i , . . . ,  , 

. Moreover,  if  Zi  belongs  to  the  domain  of  normal  attraction  of  an 

a-stable  law,  a  €  (0,2),  the  rate  of  convergence  is  (n/logn)*'’®.  The  proofs  of 
the  results  of  Sections  3-5  are  given  in  Sections  6-9.  In  the  concluding  Section  10 
we  discuss  how  to  use  our  estimator  in  practice,  and  give  the  results  of  a  small 
simulation  study  which  indicate  that  the  estimator  seems  to  perform,  in  prac¬ 
tice,  as  good  as  the  well  known  MLE  estimators  in  the  corresponding  model 
with  Gaussian  innovations. 


2.  Assumptions  and  notation 


We  consider  the  moving  average  process  (X,),^^  defined  by  (1.1).  To  formulate 
the  conditions  on  the  noise  (Ei),^^  we  introduce  the  following  functions  for 
z  >  0 
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G(z)  =  P{2?>z) 

X(x)  =  x-^EZtl(Zl<x) 

Q{x)  =  C(z)  +  K(x)  =  E  [l  A  (z-‘  Z\f]  . 
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Since  Q  is  strictly  decreasing  and  continuous  on  (0,oo)  the  identity 

(aj)  =  ^  .  n  6  Af , 

defines  a  sequence  of  positive  numbers  a„  such  that  a„  t  oo  as  n  —►  oo. 
thermore,  define 

=  neAT. 

tsl 


(2.1) 

Fur- 


(2.2) 
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For  the  moving  average  process  as  in  (1.1)  we  introduce  the  following  assump¬ 
tions:  There  exists  some  d  >  0  such  that 


(Al) 

E\Zi\*<ooi 

00 

(A2) 

lit  <  °° 

for  i  =  1  A  d ; 

j=-00 

(A3) 

n/al‘  — »  0 ,  n  — ►  00 , 

for  6  =  1  A  d ; 

(A4)  lim  limsup  P  (yjl  z  <  *)  =  0 . 

Remarks.  1)  (Al)  and  (A2)  imply  absolute  a.s.  convergence  of  the  series  (1.1) 
for  every  t  E  Z.  This  is  a  consequence  of  the  three-series  theorem. 

2)  (A2)  is  obviously  satisfied  for  every  ARM  A(p,  9)-proces8.  In  this  case  the  tpj 
decrease  exponentially. 

3)  The  conditions  EZ^  <oo,  (A3)  and  (A4)  cannot  hold  together,  since  (A3) 
and  the  SLLN  imply  that  7^  2  ^  ^  contradicting  (A4). 

4)  (A4)  is  a  stochastic  compactness  condition  on  Jn^z-  ^  necessary  and  sufficient 
condition  for  7^  ^  stochastically  compact  is 

lim  inf  K{x)/G{x)  >  0. 

»-^00 

[e.g.  Mailer  (1981)].  Furthermore,  if  7^  ^  stochastically  compact,  then  there 
exists  some  constant  c>  0  such  that  for  all  n  €  .V 

P{’rl,z<*)  <cx,  i>0, 

[Griffin  (1983)]  which  implies  (A4). 

A  natural  class  of  noise  variables  to  satisfy  conditions  (Al),  (A3)  and  (A4) 
is  the  domain  of  attraction  of  an  a-stable  rruidom  variable,  which  we  denote 
by  DA{a).  For  the  definition  and  properties  of  or-stable  r.v.’s,  their  domain  of 
attraction  and  regularly  and  slowly  varying  functions  see  e.g.  Feller  (1971)  or 
Bingham,  Goldie  and  Teugels  (1987). 

Now  if  Zi  €  DA(a)  for  some  o  G  (0, 2),  then  Zj  G  DA{a/2)  and 

lim  G{x)/K{x)  =  {4  —  a)/Q. 

Z  *00 

Then  G  is  a  regularly  varying  function  and  the  norming  constants  in  (2.2)  can 
be  chosen  as 


al  =  G^  (n~^)  =  inf  {x;G(z)  <  n"'}  ; 
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i.e.  G'~  it  the  generaliied  invene  of  G.  This  implies  that  a’  =  n^^‘*L(n)  where  L 
is  a  slowly  varying  function  and  g  7^  for  some  positive  a/2-stable  r.v.  7^. 
Furthermore,  E\Zi\*  <  00  for  d  <  a.  In  the  following  lemma  we  summarise 
these  relations. 

Lemma  2.1.  Suppose  Z\  €  DA{a)  for  some  a  €  (0,2),  then  (Al),  (AS)  and 
(A4)  hold  for  some  d>  0  and  =  n^^"L(n)  where  L  is  a  slowly  varying  func¬ 
tion.  □ 

The  following  notation  will  be  used  throughout  the  paper:  For  any  sequence  of 
r.v.'s  ^  sequence  of  positive  constants  we  introduce 


n 


=  a-’' 

fn,A  “n  ^ 

1 

1 

1=1 

n 

II 

<=i  1 

A  G  (-s,s]. 

II 

0^ 

•^t/  7n,>»  =  A%  j 

fe")  ■ 

/„,aW  =  lo.A 

1  " 

■  2 

Wii 

II 

4,e***'  .  A€( 

3.  Consistency  of  the  smoothed  normalized  pe- 
riodogram 

Kliippelberg  and  Mikosch  (1991)  considered  Zi  in  the  domain  of  normal  attrac¬ 
tion  of  an  OfStable  r.v.  (Zi  €  DNA{a)),  a  €  (0, 2);  this  means  that  Zi  €  DA{a) 
with  norming  constants  In  that  case  both  the  periodogram  ln,x(h) 

and  the  normalized  periodogrun  /n,x(h)  converge  in  distribution  for  every 
A  €  (-S’,  it],  a  common  technique  to  obtain  consistency  is  to  apply  some  smooth¬ 
ing  operation,  and  for  /n,x(h)  this  provides  a  consistent  estimator  for  the  nor¬ 
malized  power  transfer  function  |^(A)p/V'’. 
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Now  we  shall  show  consistency  of  the  smoothed  normalized  periodogram 

fn,xW  =  ^  W„(k)  T„,x  (A*) 

|S|<m 

under  leas  restrictive  conditions.  Bere  ve  nonnegative  weights  at  points 

A*  =  A  +  k/n,  |h|  <  m,  n  E  Af,  satisfying 


m  =  m„  — » oo 

,  m„/n-»0,  n-»oo, 

(3.1a) 

W„(t)  =  W„(-k), 

1*1  <  m, 

(3.1b) 

E  =  !• 

(3.1c) 

|*|<m 

— ►  OO  . 

(3.1d) 

|t|<m 

If  A*  =  A  +  k/n  ^  (— »,x]  the  term  /„_x  (As)  in  TnxW  will  be  evaluated  by 
defining  In,x  to  have  period  2ir.  The  same  convention  will  be  used  to  define 
V’(A),  A  ^ 

Theorem  3.1.  Suppose  satisfies  (A1)~(A4)  and  (S.l)  holds.  Then 

fn.xW  ^  n-00.  □ 


4.  Consistency  of  the  sample  autocorrelation 
function 

For  h£  Z  define 


where 


7n.x(A)  =  7n.xWhl.X 

7(h)  =  y[h)/rl>^ 

n-\h\ 

7n,xW  = 

tsl 

CO 

7(f»)  =  53 

i=-oo 
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Obviously,  if  £  Zf  <  oo,  7n,x(A)  is  s  consistent  estimator  of  the  autocorrelation 
function  ^(h)  of  the  results  of  Davis  and  Resniclc  (1986)  is  the 

following:  For  Zi  6  DNA{a),  a  €  (0,2),  Zi  symmetric 


((n/  logn)^/*  (7„.jr(A)  -  7(A))) ^  - 

(yu + *)  -  ^0'  -  A)  -  27(i)  7(A))  I  j 


(4.1) 


where  Vbi  ^11^21  •  •  • «« independent  r.v.’s,  Yo  is  positive  a/2-stable  and  (VSOjcaT 
are  iid  standard  a-stable.  (4.1)  implies  that  7n,x(A)  is  weakly  consistent  with 
limit  y(h)  and  the  rate  of  convergence  is  faster  than  in  the  finite  variance  case. 
Under  our  more  general  conditions  (A1)-(A4)  a  precise  result  as  (4.1)  cannot 
be  expected  but  we  prove  weak  consistency. 


Proposition  4.1.  Suppose  euiisfies  (A1)-(A4),  then 

7fi.x(A)  7(A),  AeA/",  n-»oo.  □ 

As  shown  in  the  appendix  by  replacing  conditions  (A3)  and  (A4)  by  a  slightly 
more  restrictive  condition  it  is  possible  to  obtain  a.s.  convergence  of  7„,x(A)  to 
7(A)  along  some  known  subsequence.  In  particular,  this  condition  is  satisfied 
for  Zi  €  DA(a),  a  €  (0,2).  Moreover,  we  give  an  example  to  show  that  a.s. 
convergence  need  not  hold  in  general  under  (A1)-(A4). 


5.  Parameter  estimation  for  ARMA(p,  q) 
processes 

We  consider  a  causal  invertible  ARMA(p,9)  process  (A»),j2  «atisfying  for  ev¬ 
ery  t  the  ARMA  equations 

Xt  —  <p\  Xt-i  —  . (pp Xt-p  =  Zf  +  Z|_i  . . .  -f  j  Xt-f 

for  iid  (£0(6Z-  Denote 

fp{z)  =  1  -  2  - ...  -  z'’ 

9{z)  =  1  z  -I-  —  +  0f  z^ 
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and 

0  =  (•Ph  -i’fip  I  -  -  • 


Then  in  the  infinite  moving  averse  representaion  of  our  process  we  have  that 
^(A)  =  y.(e-*)/tf(e-*). 

We  introduce  the  parameter  set 


C  =  ',<Pp  ^  0 ^  0 ,tp{z)  and  0(z)  have  no  common  zeros , 

V»(*)  ®(*)  #  0  for  |i|  <  l} 

Denote  by  g(X,R)  the  power  transfer  function  corresponding  to  fi  €  C;  i.e. 


tf(e-^) 


=  \rf>Wl\ 


and  define 


/n.x(A,) 


where  the  sum  is  taken  over  all  Fourier  frequencies 


e  (-»,»]. 


Clearly,  as  n  -*  oo,  the  sum  and  the  integral  should  converge  to  the  same  limit. 

Suppose  /7o  €  C  is  the  true,  but  unknown  parameter  vector.  Then  two  natural 
estimators  of  fio  are  given  by 


fin  =  argmin  <r*(fi),  fi„  =  argmin  o*(fi) . 

Pec  Pec 

Given  the  assumption  that  (r^(fi)  ~  it  seems  reasonable  to  assume, 

as  is  in  fact  the  case,  that  fin  fin,  and  that  therefore  the  two  estimators  are 
asymptotically  equivalent.  It  is  clear  that,  in  practice,  fin  is  the  only  applicable 
estimator,  since  the  integral  defining  <T^(fi)  will  always  have  to  be  evaluated 
by  an  approximating  sum.  Nevertheless,  throughout  this  paper  we  shall  give 
proofs  of  convergence  for  the  estimator  based  on  o'^(fi),  since  here  the  notation 
is  much  lighter. 

The  choice  of  these  estimators  is  motivated  by  the  fact  that  the  function 

r  giKPo) 
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has  its  absolute  minimum  at  —  0o  in  C.  [cf.  Brockwell  and  Davis  (1991), 
Proposition  10.8.1.].  Moreover,  by  Theorem  3.1.,  In,x(^)  can  be  applied  to 
estimate  y  (A,  ^o)/  (^o)f  where  is  the  quantity  corresponding  to  fio- 

For  Gaussian  estimator  fin  is  closely  related  to  least  squares  and 

maximum  likelihood  estimators  and  it  is  a  standard  estimator  for  ARMA  pro¬ 
cesses  with  finite  variance.  The  idea  goes  back  to  Whittle  (1953),  see  also  Dzha¬ 
paridze  (1986),  Fox  and  Taqqu  (1986)  and  Dahlhaus  (1989).  It  is  well-known 
that  in  the  classical  case  fin  is  consistent  and  asymptotically  normal  [cf.  Brock- 
well  and  Davis  (1991)].  We  show  that  fin  is  also  for  ARMA  processes  with 
infinite  variance  a  weakly  consistent  estimator  for  the  true  parameter  vector  fio- 

Theorem  5.1.  Suppose  (A't),^^  ^  causal  invertible  ARMA(p,q)  process  and 

conditions  (A1)-(A4)  hold.  Then 

fin fio  and  <r*(^„)  ■^2irV’"*(/?o)  .  n  — oo. 

Furthermore,  the  same  limit  relationships  hold  also  for  fin  and  of,  ■  ^ 


As  shown  in  the  Appendix,  it  is  possible  to  obtain  a.s.  convergence  along 
some  specified  subsequence  under  more  restrictive  conditions  which  hold  e.g. 
for  Zi  €  DA{a),  a  €  (0,2). 

For  ARMA(p,f)  processes  with  finite  variance  fin  is  asymptotically  normal 
with  rate  of  convergence  of  order  An  analogous  result  gives  in  our  case 

a  rate  of  convergence  of  order  (n/log  n)“*^“:i.e.  the  convergence  is  considerably 
faster  (since  a  <  2). 

To  obtain  a  representation  of  the  limit  vector  we  restrict  ourselves  to  sym¬ 
metric  Zi  e  DNA(a)  for  a  €  (0, 2)  such  that 

n 

-i  Y  (5.1) 

»=i 

where  Y  is  a-stable. 

Recall  that  a  random  variable  Y  is  said  to  have  a  stable  distribution  (Y  = 
■5<,(<r,^,/i))  if  there  are  parameters  0  <  o  <  2,  (T  >  0,  -1  <  1?  <  1,  and  /i  real 
such  that  its  characteristic  function  has  the  form: 


E  (e’**') 


exp  (1  -  i/9(sign^)tan  -I-  ipO} 

exp  ^1  +  ^(sign  9)  In  -f  i/rtf  | 


ifo  ^  1, 
if  Q  =  1 . 
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If  =  /i  =  0  then  y  is  symmetric  and  we  say  that  Y  has  a  “symmetric  a  stable” 
distribution,  denoted  by  V  =  SaS. 

For  later  use,  let  Ca  be  the  constant  defined  by 


Cc 


I 


l-a 

r(2-«)co.(Y) 

2 


if  a  ^  1 
if  o  =  1. 


(5,2) 


Theorem  5.2.  Suppose  ^  ARMA(p,g)  process  and 

symmetric  such  that  (5.1)  holds.  Then 

^  2/tt 

where  yo,yi,y2,  -  independent  r.v.’s,  Yq  =  SaiiiC^j^  .1|0)  positive 
a/l-stahle,  *‘<f  Sa5  with  scale  parameter  a  =  W"'  (fio)  w 

the  inverse  of  the  matrix 

iT 

dX, 


r  rainj(A,fio)] 

■ainy(A,fio)' 

L,  dp 

dp 

and,  for  k  £A(,  bt  is  the  vector 


dp 

Furthermore,  (5.3)  holds  also  with  fin  replaced  by  0„  □ 


The  limit  vector  in  (5.3)  is  the  ratio  of  an  a-stable  (p  +  9)-dimensional  vector 
over  a  positive  a/2-stable  r.v.  It  is  not  difficult  to  see  that  for  AR{p)  processes 
fin  is  just  the  formal  analogue  of  the  Yule- Walker  estimates.  Their  weak  limit 
behaviour  was  derived  by  Davis  and  Resnick  (1986)  using  time  domain  methods. 

In  closing  we  note  that  “more  rapid  than  Gaussian”  rates  of  convergence  for 
estimators  in  heavy  tailed  problems  seems  to  be  the  norm  rather  than  the  excep¬ 
tion.  For  example,  Feigin  and  Resnick  (1992, 1993)  study  parameter  estimation 
for  autoregressive  processes  with  positive,  heavy  tailed  innovations,  and  obtain 
rates  of  convergence  for  their  estimator  of  the  same  order  as  ours,  but  with¬ 
out  the  logarithmic  term.  Their  estimators,  however,  are  different  to  ours  both 
in  spirit  and  detail,  and  involve  the  numerical  solution  of  a  non-trivial  linear 
programming  problem. 


Estimation  for  inAnite  variance  ARMA  models 


10 


6.  Auxiliary  results 

We  shall  frequently  make  use  of  the  following  decomposition  of  the  periodogram. 
Its  proof  is  given  in  Proposition  2.1  of  Kliippelberg  and  Mikosch  (1991). 

Proposition  6.1.  Suppose  "  moving  avenge  process  as  in  (1.1)  and 

(A.l),  (A.t)  are  satisfied.  Then 

In.xW  =  /n.z(A)  +  R„{X) ,  -r  <  A  <  T 

where 

ft.(A)  =  tfr(A)J„(A)y„(-A)  +  ^(-A)7„(-A)y„(A)+|y„(A)|* 

JnW  =  a;‘^Z,e-**‘ 

1=1 

y„(A)  =  f;  V-i  l/ni(A) 

js-oo 

tsl-j  fssl 

The  following  Lemma  is  similar  to  Davis  and  Resnick  (1986),  p.  549,  see  also 
Lemma  5.1  of  Kliippelberg  and  Mikosch  (1992). 

Lemma  6.2.  Suppose  (Af|),^2  satisfies  (A1)-(A4),  then 

Tn.x  =  7*.z(l  +  or»(l)) .  n  — 00. 

Proof. 

t=l  j=— oo  »=1  i^j 

=:  V1  +  V2. 

Then  the  triangle  inequality  gives 

E\V2\‘<o-^*  n^dt^illV-;!)*  E\Z,Z2f  - 

w 


0 
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and 


t=l 


f/2 


<  2a-*  ^  |V->|‘  lilEl^.l‘^0.  a 


j=-oo 


Lemma  6.3.  Lei  {Zt),^2  of  iid  r.v.’s.  Then  the  following  rela¬ 

tions  hold  for  n  — »  oo; 


E  Zl  Zl  =  0(r 

n- 

(6.1a) 

(h)  If(Al),  (AS)  and  (Af)  hold,  then 

E  Z\  Z2  — 

o(t.-')  , 

(6.1b) 

JP  z\  Z2  z^  = 

o{n-^)  , 

(6.1c) 

E  Zl  Z2  Z^  Z4  = 

(6.1d) 

(c)  If  (Al)  and  (AS)  hold,  then 

n  — h 

«=1 

0 ,  />  €  A/i) . 

Proof. 

(a) 


n(n  -  1)£  Z?  ^  Zf  Z]  <E(j2  Zf]  = 

•*•»»  \l=l  / 


(«:) 


E 


®n  ^  ^  Zt+h 
t=l 


<a-^‘{n-h)E\Z,Z2f  f*0. 
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•»— I  — 

(b)  By  Holder’s  inequality,  ^  Z<  Zt+i  lei,  n^M,  thus  the  sequence 

1=1 

Zt  Zt^\ )  is  uniformly  integrable. 

»=i  /«€V 

Part  (c)  and  (A4)  imply  that 

Zt  Zt+t  =  7n,Z  “n  ^  53  ^  ®  • 

1=1  1=1 

Hence 

n— 1 

E  ^1+1  "  —  1)  £  Z\  Z2  0 . 

1=1 

This  proves  (6.1b).  The  proofs  of  (6.1c)  and  (6.1d)  are  similar;  we  only  prove 
(6.1d); 

([n/2]  -  l)(n  -  [n/2]  -  1)  \e  Zi  Z2  Z3  Z^\ 


nn/2]-! 

n-l  ") 

/  ft"/*!  "  1  ^ 

E  <  53  •^‘+1 

'  E^?+  E 

[1  ‘=» 

,=Cn/2)+l  }  / 

[  1=1  l=[n/2)+l  J  J 

ln/2]-l 

n-l 

53  Zt  Zt+i 

E 

1=1 

l=(n/2]+l 

l»/2] 

Ej 

n 

E 

1=1 

l=[n/2)+l 

by  (6.1c).  O 


7.  Proof  of  Theorem  3.1. 

As  a  structural  part  of  Tn,x('^)  define 

Cl,  :=  53  W^n(*)cosAt(t -«) 
|t|<m 

and  prove  some  asymptotic  relations  for  n  — >  oo. 


Lemma  7.1. 
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I.J  =  1 


X)  C?,  =  o  (n*)  =  ^  el , 


ct,  ctr  =  0{n) ,  Y2  =  °  ("^)  ■  ~  ^ 

t  J  f=l 


Proo/.  (a) 

X^c*.  =  XZ 

t,<  (,< 

=  XZ  +^]^8inAt<^  1  =  0(1). 

(b)  c?,  =  X)  cl+n,  and  the  result  follows  from  equation  (6.2)  of  Kluppelb»*rg 

t,t  t^S 

auid  Mikosch  (1992). 

(c)  Using  trigonometric  sum  formulas  we  obtain 

X^ct.Cr  <  XT  *^n(kj)  W^f.  (*2)  X^  cos  At,  (t-s)  cos  At,(t-r) 

t,»,r  |t]|,|i;3|<m  t,i,r 

<  X^  W^n(fcl)  W^n(*2)s  XZcOsA*,tC0sAt,t^  cos  At,  s^  cos  At,  r 

|t,|,|t,|<m  U  «  »  r 

+  cos  At, t  sin  At,t  cos  At,  s  sin  At,r 


+  [^  sin  At,  t  sin  At,t  XI  sin  At,  s  ^  sin  At,r 
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sin  At,  ( cos  At,<  sin  A*,  s  cos  At, r 


n  (^2)^  don  = 


0(n) 


for  some  constant  do  >  0.  Furthermore,  there  exist  constants  di,  d2,  ds 
such  that  by  (a)  and  (b) 


t.t.T 


t.r 


<.• 


—  X  + <^1  ” + <^2  X  ■*■  *^3  X 

M.''  t,r  l,j 

= 

That  the  sum  Ci,  c,«  =  O  (f»*)  follows  similarly.  O 

We  apply  Proposition  6.1.  and  Lemma  6.2.  to  Tn,x  an<l  obtain 

fn,xW  =  Wn{k)T„,x{h) 

\k\<m 

=  {V--’  X  /n.2(At) 

|t|<m 

+  7-|  X  ^  }  (*  +  • 

|t|<m 

Since  max  |At  —  A|  — » 0  as  n  -*  00  and  |V’(A)|^  is  uniformly  continuous, 
|*|<m 


(7.1) 


max 

|*|<m 


||V-(At)|"-|t(-(A)|’|-0,  n 


00  . 


Thus  we  conclude  that 

X  W^«(*)IV-(A*)P  7„,z(At)  =  (l  +  o(l))|^(A)|2  X  W^»(*)7..z(At) 

\k\<m 

=  (l  +  o(l))|^(A)p  (l  +  g„(A))  , 


(7.2) 


where 


Qn(A)  =  X  ^n{k)  X  -  »)  • 

|S|<m 


t.vsl 

<#» 
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Lemma  7.2.  Qn(^)  0,  n  — »  oo. 

Proof.  We  prove  E  ^Qb(A)^  — *  0  as  n  — »  oo:  There  exist  constants  dx,  dj,  ds 
such  that 


5’ (A)  =  X)  +  “'a  X 

ds  C|*  Cru  Zt  Zt  Zr  Z^t  f 

t^s^r}(v 

and  the  result  follows  from  Lemmas  6.3.  and  7.1.  □ 

In  view  of  (7.1),  (7.2)  and  Lemma  7.2.  it  remains  to  prove  that 

7Z.I  X  »^n(*)iL.(A*)-0. 

|i|<m 

By  the  decomposition  of  Proposition  6.1.  and  by  Holder’s  inequality,  we  have 
for  some  constant  c>  0 

X  W'"(*)^"(A*) 

|Jk|;£m 

<<=’ (x  f  X  +  X 

/  \l*l£m  /  |t(<m 

By  (7.2)  and  Lemma  7.2., 

T'n.l  Z)  ^"(*)  =  X  ^"(*)  (^0  =  Oi>(l) , 

|*|<m  |t|<m 

hence  it  suffices  to  show  that 

7„'.z  X  (7-3) 

|t|<m 

By  the  decomposition  of  Proposition  6.1.  we  have 

l>'n(At)|*<2(Ait+>4») 


where 


■Ai*  =  I  X 

l»l>" 
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An 


J 


.-i 


l«l<» 


Lemma  7.3.  7"^  W^nC*)  An  0. 

|t|<m 

Proo/.  We  have  for  some  c  <  00 


^  W„ik)Ais<e{Vx  +  Vi) 

|*|<m 


where 


Vi 


E  ^«(*) 

|*l<m 


E  E  *■ 


lAkP 


I«l>» 


V'l  =  a;»  ^  w„(jfc) 

|*|<m 


E 


l«l>n 


fn,z(Ai)  . 


Note  that 


7n,Z 


V2  <  f  E  i^‘i)  E  »^"(*)  (^*) = • 

\l»l>»  /  1*1  <m 


By  (A4),  it  remains  to  show  that  V\  -*  0.  We  restrict  ourselves  to  prove  that 

»-t  * 

E^« '■’***  E 


Vn  =  a;*  Y1 

|*|<m 


l>n 


rsX-f 


=  a;’  E  ^»(*) 

lt|<m 


E^« 

Iss^eo 


r=(n+l)A(l-l) 


0. 


We  have  for  some  positive  c 


<  <^n*E 

E  1 

f  -1 

E  i^‘i  E  iv-M 

|*|<m 

^ts-oo  r=(n+l)A(l-f)  / 
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= 


-1 


E  E 

ts-oo  r={n+l)A(l-0 


<  co-^  E  E 

»=-00  r=(n-i-t)A(l-l) 

<  C  On'  E  1^1  ® 

t=— oo 

p 

and  an  application  of  Markov’s  inequality  proves  Vn  -*  0.  □ 

Lemma  7.4.  7"^  ^ 

|*|<m 

Proof.  In  view  of  (A4)  it  suffices  to  show  that  ^  W„(i)  Aj*  0.  We  restrict 

|t|<m 

ourselves  to  show  that 


V3  =  a;*  53  Wnik) 

|t|<m 

«  a;*  53  Wn{k) 

|t|<m 


t=l 

El^.  «-■*“  (  E  -  T,  Zt 

«=1  \/=J-l  r=n-«+l  / 


We  have  for  some  positive  c 

EWzf^  <  a-*E 


ElV'.lf  E  i^^i+  E 

1=1  \r=i-i  r=n-f+i  / 

<  ca-*  53  l^«l*  l<l  — 0. 


Markov’s  inequality  proves  0-  O 
Final  7  re  combine  Lemmas  7.3-  and  7.4.  which  gives  (7.3);  this  proves  The¬ 


orem  3.1.  □ 
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8.  Proof  of  Proposition  4.1. 

We  mimic  the  proof  of  Davis  and  Resnick  (1986),  pp.  548-550.  For  any  h 
we  have 

^ Xt  -  7(h) =  (V-i+ik  -  7(A) ^i)  Zt-i  Z,.j 

,=»  ^  -“’‘i  (8.1) 

+ E  E  (^•+*  -  t(a)  *i)  -  ^t)  =■  vi + V2 

«sl  i 

where  we  used  the  fact  that  ^  V't  {i>i+h  -  7(h)  rl>i)  =  0.  By  (A1)-(A3)  we  obtain 
for  some  Ci  >  0,  t  =  1,2, 3, 4. 

E  |a;*  Vi I*  <  Cl  n  a"”  ^  IV*.  (0,+k  -  7(A) 

<  ca  n  a~^*  -►  0 , 
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9.  Proofs  of  the  results  in  Section  5 

The  proofs  in  this  section  are  modelled  on  those  in  the  finite  variance  case,  due 
initially  to  Hannan  (1973).  [cf.  the  treatment  in  Btockwell  and  Davis  (1991), 
Section  10.8,  which  we  follow  closely].  The  technical  differences  in  the  infinite 
variance  case  are,  however,  substantial. 

Throughout  this  section  we  shall  treat  only  the  estimator  fin,  based  on  min¬ 
imising  an  integral  of  the  integrated  periodogram.  The  estimator  fin ,  based  on 
the  summed  periodogram,  can  be  treated  similarly.  Unfortunately,  as  in  the 
Gaussian  case,  there  seems  to  be  no  easy  way  to  exploit  the  “obvious”  asymp¬ 
totic  equivalence  of  fin  and  fin,  so  aa  to  obtain  the  consistency  and  asymptotic 
distribution  of  one  directly  from  the  other.  Since  a  full  proof  of  this  equividence 
involves  treating  the  differences  between  the  higher  order  terms  in  the  Taylor 
expansions  of  <T^(fin  —  fie)  ^d  On{fin  —  fie),  uid  this  is  no  easier  than  deriving 
the  results  for  fin  directly,  we  refer  the  reader  to  the  thesis  Gadrich  (1993), 
where  essentially  the  same  arguments  used  below  for  fin  are  aq>plied  to  fin  ■ 

We  start  with  some  auxiliary  results. 

Lemma  9.1.  Suppose  {Xt)^^^  ”  ^  causal  invertible  ARMA(p,q)  process  and 
conditions  (A1)-(A4)  hold.  Then  for  every  fi  sC 


(9.1) 


|«m(A,^)-p,-‘(A,^)|<e/(4ir) 
for  all  (A,/3)  e  [-*■.»■]  x  Hence 

<'IM  -  J\  7n,xW  9m(A.  0)dX  <-^  J'  7„.x(A)  dA  =  c/2 ,  €  ^ . 

Hence  for  fixed  e 

P  (jup  !<.(«  -  *-’(«/_'  f^JA|  >  .) 

= C”^h,£,  (‘  ■»)**■  -  5) 


Estimation  for  infinite  variance  ARM  A  models  21 


The  first  summand  on  the  rhs  converges  to  sero  in  view  of  Proposition  4.1. 
and  because  the  6^  are  uniformly  bounded  for  fi  €  ?  and  m  fixed.  The  second 
suiiunand  is  sero  provided  m  is  chosen  sufficiently  large  ( see  p.379  in  Brockwell, 
Davis  (1991)).  a 

Proof  of  Theorem  5.1.  We  adapt  the  proof  of  Theorem  10.8.1  in  Brockwell  and 
Davis  (1991).  We  suppose  that  does  not  converge  in  probability  to  fio.  We 
have  by  Lemma  9.1.  that 

P{<rl{pn)  <t)>  P{(ri{0o)  <  f)  -  P(2xtl>-^(0o)  <  t).  (9.3) 

for  every  t.  By  the  Helly-Bray  theorem  and  the  compactness  of  ^  there  exists  a 
non*tandom  subsequence  such  that  0n„  converges  in  distribution  to  a  random 
variable  which  is  different  from  fio  on  a  set  of  positive  probability.  The 
functional  F(/,x)  =  /(*)  mapping  C(C)  x  ^  to  71  is  continuous  where  C(^)  is 
the  space  of  continuous  functions  on  ^  equipped  with  the  supnorm.  According 
to  Lemma  9.1.,«rJ  ,(•)  converges  in  probability  to 

f  is  tight.  Since  -i  0  the  sequence  0„^  is  tight  as  well.  Thus  (<r*^  4.^n») 
is  tight  in  C(C)  x  C  and  there  exists  a  further  subsequence  (we  use  nt  for  the  ease 
of  notation)  such  that  (cr^^f,0nt)  converges  in  distribution.  By  the  continuous 
mapping  theorem  we  conclude  that 

=  <.,(^nj  -  r/>-\0o)  I' 

Thus  we  have 


P«{M<t)<P{<Tl^,,{0nJ<t) 
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r _ 


+ 

'  g(A.^) 


’  g(A,/9b) 


dX>2T,0:^fio) 

dX<2ir,0^0o) 


Choosing  6  close  to  zero  the  last  summand  can  be  made  arbitrarily  small.  Thus 
we  conclude  that 


limsupP(<r2^(/3„J  <t) 

*-•00 

<  P(V--"(i?o)2ir  <t,0  =  0o)  +  Pitl>-\0o)  f 

<  P(^-H0o)2^<t,0  =  0o)  +  Pirl>-H0o)2^<tJ^0o)  (9.4) 

Now  choose  t  =  2tiI>~^{0o)-  We  obtain  from  (9.3)  and  (9.4)  that 

1  =  P(V.-’(/?o)2ir  <  t)  <  P(V>-*(A))2ir  <t,0  =  A) 

which  yields  a  contradiction  since  the  event  {p  ^  0o}  has  positive  probability. 
□ 


Lemma  9.2.  Suppose  the  assumptions  of  Theorem  5.2.  hold.  Furthermore,  let 
T]  he  a  continuous  function  on  [— x,)r]  sacA  that 

(j^)*^'’/%(A)g(A.A.)  Tn,z{X)dX  =  0,{l),  n-oo. 

Then 

(i^) f,  ^  °  ■ 

Proof.  Set  x„  =  (n/  logn)*^“  and  note  that  On  =  cn'/®  for  some  constant  c>  0. 
By  the  decomposition  of  Proposition  6.1.  and  Leimna  6.2.  we  get 

f  Tn,xW  nW  dX  =  r  ’  {Po)  (1  +  0/>(l))  I'  In,xW  »7(A)  dx 
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=  (Aj)  (1  +  Of  (1))  J’  Tn.zW  g  (A.  fio)  f]{X)  dx 

+  r *  (^o)  (1  +  op(l))  y'  R^{X)  T,{X)  dX 

By  the  assumptions  it  suffices  to  show  that 

*n  f  ft.(A)l,(A)(fA  =  Of(l). 

We  apply  Holder’s  inequality  and  obtain  for  some  c>  0 
ly’  R„{X)  q(A)dA|  <  c^'  |i2„(A)|  dX 

<  c|  (y*  /„.z(A)  dxY^  (y'  iy„(A)i*  dAy^* + y'  iy„(A)i*  dA| . 


Thus  it  remains  to  show  that 


fjYn{X)\^dX  ^  0 

We  have 

y’  |y„(A)f  dA  <  cn-*/<*  I 


L 


n-j 


i:  ^.e--‘ 

j>n  «=l-j 


dA 


£ 

■£ 


(=1 


dA  + 


£ 


;  =  1  »=1-; 


7=1  Issn-i+l 


-tAf 


dA 


=:  cn-2/»(yi  +  y2  +  y3  +  v^s)  • 

It  suffices  to  show  that  the  Vi  are  stochastically  bounded.  We  will  show  this  for 
V\.  The  other  estimates  are  similar.  Note  that  Vi  =  |Q(A)|^dA  where 

QW  =  E  E 

j=-oo  »=(n+l)A(l-j) 
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Let  Bi  and  Bj  be  two  independent  Brownian  motions  on  [—*’,«’]  and  suppose 
that  they  ate  independent  of  (Zt).  Then 


=  £  £  e 


=  £e-T‘'.. 


Here  Ni,Ni  are  i.i.d.  standard  Gaussian  r.v.*s  independent  of  {Zt). 

In  order  to  show  stochastic  boundedness  of  Vi  it  thus  suffices  to  prove  that  the 
real  and  the  imaginary  parts  of  Q(A)dBi(A)  are  stochastically  bounded.  We 
restrict  ourselves  to  the  real  part. 

We  introduce  the  gauge  function  Ao  for  any  r.v.  A  by 

Aa(A)^  (sup  t-  P(|A|>t) 

V«>o 

Then  for  any  sequence  of  real  numbers  we  have  for  some  constant  >  0 

j^aiZA<c„'^\atrAl{Zt;) 

/  i=l 

[see  e.g.  Kliippelberg  and  Mikoech  (1991),  Lemma  3.4].  Then  for  fixed  (  >  0 

p(|y'Re(g(A))dBx(A)|>e) 

E  E  dBi(A)  >  s 

j=-oo  »=(n+I)A(l-j) 
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-i 


<  CaAliZo)  ^ 


J  =  -00 
-1 


2  rl>,r  Re[e-•^^'*^^)dB^(X) 

.=(n+l)A(l-i) 


fl-^ 


a/2 


=  c»A“(Zo)  X]  E 

j=-oo  V=(n+J)A(l-i)  > 

^  C  lV'jr''‘i<00 

J=-00 


Here  (Aj)  is  a  sequence  of  identically  distributed  (but  dependent)  Gaussian 
r.v.’s  and  c  is  a  positive  constant.  In  the  last  step  we  made  use  of  condition 
(A2).  This  proves  the  stochastic  boundedness  of  Vi.  □ 


Lemma  9.3.  Suppose  ike  assumptions  of  Theorem  5.2.  hold.  Furthermore,  let 
j)  be  an  odd  continuous  function  on  [—*',*']  and  the  Fourier  coefficients  ft, 
k  ^  Z,  of  T){X)  g{\,SQ)  satisfy  |/i I"  <  oo /or  some  ;i  €  (0, 1  A  a).  TAen 

ll=— OO 

(i^)  "7.'. ~ 

where  Yo,Yi,Y2,  . . .  are  independent  r.v.  ’s,  Vo  is  positive  Q/2-stable  and  (Yt),^^ 
are  iid  symmetric  a-stable  with  ch.f.  Ee**^'  =  t  ^Ti. 


Proof.  We  adapt  the  proof  of  Preposition  10.8.6  of  Brockwell  and  Davis  (1991). 
In  view  of  Lemma  9.2.  it  suffices  to  show  that 

*n  r  /n.z(A)  •7(A)  g  (A,  0o)  dX  -  4t  f)  ^  A 
J-r  rr(  Yo 


where  x„  =  (»j/logn)''^“.  Set 


X(A)  =  .7(A)<7(A,/3o) 


Xm(A)  =  A  with 

Hi|<m 


and 
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The  assumptions  on  (/i )  imply  that  uniformly  in  A 

OO 

XmW  -*  X(>)=  /*«'**•  »"  —  «>■ 

ks~ao 

Moreover,  /o  =  0.  We  show  that  for  all  e  >  0 

lim  limsup  p(xn\f  7n,z(A)  (x(A)  -  Xm(A))  JaI  >  =  0 .  (9.5) 

For  n  €  .V  and  h  €  2  we  set 

fi-|A|  /  n 

7«.z(A)  =  7«,z(|A|)  =  'ZZ,  Z.+|*|  / 

1=1  /  «=i 

and  yn  =  (nlogn)*^*  .  Then  for  n  >  m  there  exists  some  ci  >  0 
Vi  =  7«.z(A)(x(A)-Xm(A))<iA 

=  *"  /  I  E  E 

•'-*  \|kl<n  |t|>m  / 

=  x„  2x  53  7'* 

m<|ft)<n 

/  n— 1  n— fc  ^ 

=  Ci7;’^y;'{  53  /.  '£z,z,+h\ 

l^sm+1  <sl  ) 


n— m— 1  n— t 


=  ^iy;}yn^  E  E  7*^.+^ 


t=l  A=m+1 


=  ClVlVn’  E  E  fk-t^h 


<=1  k=m+t+l 


=  ci7„.z'^2- 

Since  7^  ^  7*  for  some  positive  Q/2-8table  r.v.  7*  for  (9.5)  it  suffices  to  show 

that  for  every  c  >  0 


lim  limsup  P  (|Kj|  >  c)  =  0 . 

m-^OO  fi-^OO 


L 
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An  application  of  Theorem  3.1  of  Rosinski  and  Woyczynski  (1987)  yields  for 
some  C2  >  0 

pm  >  £)  <  C2  i  x;'  Yi 

Note  that  for  x  6  (0, 1), 

x"  ^1  +  log+  <  x" 
where  ft  €  (0, 1  A  a).  Hence  for  constants  C},  ca  >  0 

/’(|V2|>0  <  t  lA-.r 

t=l  h=fn+t+l 
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The  specific  scaling  constants  in  the  statement  of  the  lemma,  and  in  Theorem 
5.2,  then  follow  from  the  representation  of  the  Yi  given  in  Davis  and  Resnick 
(1986)  and  the  results  of  Le  Page  (1980). 

This  together  with  the  continuous  mapping  theorem  proves  (9.6).  □ 


Proof  of  Theorem  5.2.  We  adapt  the  proof  of  Theorem  10.8.2  of  Brockwell  and 
Davis  (1991).  A  Taylor  expansion  gives 

80  ~  80  80^ 


=  -i0n-0o) 


80^ 


for  some  0^  with  |(^*  —  0n\\  <  \\0n  -  ^o||  where  ||  •  ||  denotes  the  Euclidean 
norm.  Now 

g-^(A,/?;) 

80^ 


=  fjn.xW  '  ’  dX 


P 

and  since  0\  -*  0o  similar  arguments  as  in  the  proof  of  Lemmas  9.1.  yield  that 

’a#”  ^  (0o)J_^9(K0o) — — dx. 

Following  the  lines  of  the  proof  in  Brockwell  and  Davis  (1991)  after  (10.8.39) 
the  same  uguments  lead  to 

d^<rl{0-„)  p 

80^ 

Hence  it  suffices  to  show  that 
_  d<rl(0o) 


i>-H0o)  W{0o)  ,. 


d0 


-1  4iril;-^(0o)  S  ^ 


lr=l 


where  6*  is  defined  in  Theorem  5.2.,  or,  equivalently,  by  the  Cramer- Wold  device 
that  for  all  vectors  c  €  TV*’* 

T  (^o)  <  -2/0  nV" 


x„  c' 


00 


-1  4x^"*(ao)  ^  ^  6*  • 


t=i 


J 
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We  have 


rdoUM  T  f'j  (..d9-HK0o) 

c  -  c  ]jn.xW  - Yp - dX 

=:  f  L,xW  17(A)  dX 

where 

— afi 

is  an  odd  continuous  function.  Furthermore,  it  is  not  difficult  to  see  that  the 
Fourier  coefficients  of  T}(X)g(X,0Q)  satisfy  the  conditions  of  Lemma  9.3.  An 
application  of  this  lemma  implies  that 

*„  r  Tn.xW  »J(A)  dX  4  4ir  V--'(fio)  E  ^  A 
J-,  ^  yo 

where  ft  are  the  Fourier  coefficients  of  17(A)  j  (A,  fio);  >  e- 

Thus 

for  all  c  e  This  implies  that 

dol{0r>)  a  . 

where  bt  is  the  vector 


10.  An  application  to  simulated  data 

To  get  some  idea  of  how  the  Whittle  estimator  behaves  in  the  heavy  tailed 
situation,  we  ran  a  small  simulation  study.  Before  describing  the  results,  we 
make  some  conunents  about  the  application  of  the  estimator. 
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Aa  noted  earlier,  in  application  it  is  the  estimator  fin  •  based  on  the  summed 
periodogram,  that  is  used.  In  fact,  whereas  until  now  we  worked  with  the  self- 
normalised  sample  periodogram  /n,x>  in  practice  it  makes  more  sense  to  work 
with  the  regular  periodogram  /n,x(^)  defined  by 

t=i 

In  this  case,  it  is  immediate  from  the  definition  of  fin  that  it  could  have  also 
been  defined  as  the  minimiser  of 


—X  <  A  <  X. 


where  the  sum,  as  before,  is  taken  over  all  Fourier  frequencies.  (The  difference 
between  d*  and  d*  lies  in  factors  of  n  and  the  normalisation  Xf,  neither  of 
which  affect  the  minimisation.) 

It  should  be  emphasised  that  minimisation  of  (10.1)  requires  knowledge  of 
neither  the  stability  parameter  a  nor  the  scale  parameter  o  of  the  data.  (This, 
of  course,  is  not  true  if  one  wants  to  determine  the  convergence  rate  of  the 
estimator.)  This  fact  has  two  important  consequences.  The  first  is  that  although 
there  exist  methods  for  estimating  stable  exponents  [e.g.  Dzhaparidze  (1986), 
Hahn  and  Weiner  (1991),  Hsing  (1991)  and  Koutrouvelis  (1980)]  none  of  these 
have  very  good  small  sample  behaviour,  and  so  it  extremely  comforting  to  have 
an  estimator  that  is  a  independent. 

The  second  consequence  is  that  since  it  is  well  known  that  the  Whittle  esti¬ 
mator  is  asymptotically  equivalent  to  the  MLE  in  the  Gaussian  case,  the  fact 
that  in  the  stable  case  the  Whittle  estimator  is  an  identical  function  of  the  data 
implies  a  robustness  property  for  both  the  Whittle  and  maximum  likelihood 
estimators  in  the  Gaussian  case  as  well. 

The  following  table  includes  the  result  of  a  small  scale  simulation  study.  We 
generat  ;-d  100  observations  from  each  of  the  modeb 


1. 


0.4  Xt-i  =  Z, 
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2.  Xt  =  Zt  +  0.8  Z,_i 

3.  Xt  -  0.4  X,_i  =  E.  +  0.8  Z,_i 

where  the  innovations  sequence  {Zt}  was  either  iid  a-stable  with  a  =  1.5  and 
scale  parameter  equal  to  2.0,  or,  for  comparison  purposes,  A^(0,2).  (In  the 
stable  case  we  relied  on  the  algorithm  given  by  Chambers,  Mallows  and  Stuck 
(1976)  for  generation  of  the  innovation  process.)  We  ran  1,000  such  simulations 
for  each  model.  In  the  stable  example  we  estimated  the  ARMA  parameters  via 
the  estimator  0n ,  nnd  in  the  Gaussian  case  via  the  usual  MLE  estimator.  The 
results  were  as  follows; 


Model 

No. 

Tiue 

values 

Whittle  estimate 

M  aximum-1  ikelihood 

mean 

St.  dev. 

mean 

st.  dev. 

1 

o 

II 

0.384 

0.093 

0.394 

0.102 

2 

d  =  0.8 

0.782 

0.097 

0.831 

0.099 

3 

\p  =  0.4 

0.397 

0.100 

0.385 

0.106 

oq 

o 

It 

0.736 

0.124 

0.815 

0.082 

Table  10.1;  Estimating  the  parameters  of  stable  and  normal  ARMA 
processes  via  Whittle  and  MLE  estimates. 

We  shall  not  attempt  to  interpret  these  results  for  the  reader,  but  merely 
point  out  that  the  accuracy  of  the  Whittle  estimator  in  the  stable  case  seems 
indistinguishable  from  that  of  the  MLE  in  the  Gaussian  case. 

Finally,  a  comment  about  estimating  p,  q,  a  and  the  scale  parameter  of  the 
stable  innovations.  We  have  assumed  throughout,  including  in  the  simulation 
above,  that  p  and  q  are  known.  When  this  is  not  that  case,  Bhansali  (1984, 
1988)  has  proposed  a  technique  for  estimating  p  and  q  that  seems  to  work  well 
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in  practice.  Estimation  of  a  can  be  done  either  from  the  raw  data,  or  from 
the  residuals  calculated  after  parameter  estimation.  Limited  experience  with 
simulations  indicates  that  it  is  best  done  on  the  (supposedly  iid)  residuals. 


Appendix 


In  Theorem  5.1.  we  proved  weak  convergence  of  the  estimated  coefficient  vec¬ 
tor  to  its  true  value  ^o-  In  the  finite  variance  case  this  holds  even  almost 
surely.  In  the  infinite  variance  case  (which  is  e.g.  satisfied  for  Zi  £  DA(o), 
a  €  (0, 2))  we  obtain  a.s.  convergence  under  a  more  restrictive  condition  if  we 
take  the  limit  along  a  well-specified  sequence  in  We  introduce  the  following 
condition: 


(AS)  There  exists  a  sequence  of  positive  numbers  e„  such  that 

n 

liminf  e~*  1  (AP  I) 

tsl 

where  the  norming  constants  e„  satisfy  the  following  conditions:  There  ex- 

OO 

ist  some  d  >  0  and  €  AC  such  that  for  n*  =  k*' ,  k  £  AC,  (”*  «n  **  +  <ir/)  < 

k=l 

for  6  =  I  Ad,  and  (cn/enk)  bounded  away  from  0  and  oo  uniformly  for 
n  €  [n»,ni+i]  for  all  k  £  AC. 


A  survey  of  results  of  type  (AP.l)  can  be  found  in  Pruitt  (1990,  p.  1149). 
Fristedt  and  Pruitt  (1971)  proved  under  the  restriction  ElZif  <  oo  for  some 


d  >  0  that  (AP.l)  holds  with 


el  = 


log  log  n 


(AP.2) 


q(^loglogn/n) 
for  some  constant  4  >  1  where  q(  )  =  log  E  e~  ^ 

If  Zi  £  DA{a)  for  a  £  (0, 2)  we  deduce  from  (AP.2)  the  following  Lemma. 


Lemma  1  Suppose  F  £  DA{a),  a  £  (0,2).  Then  (AS)  is  satisfied  for  d  <a 
and  e^  =  n^C<>  £,^n)  for  some  slowly  varying  function  L.  The  number  u  in  (AS) 
can  be  chosen  to  satisfy  v  >  a/(25  —  a)  V  (a/5)  provided  6  >  a/2.  □ 
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The  following  result  complements  Proposition  4.1. 

Proposition  2  Suppose  •stis^es  (Al),  (At)  and  (AS).  Then 

7».,x(A)  ^  if(A) ,  A  6  -V ,  n  —  00 . 


Proof.  We  use  the  decomposition  of  (8.1)  and  obtain 


nk+i 


max  mi  <53  (^i+k  -  7(A)  t^-i))  |  \Z,.i  Z,-j  \  . 

By  (Al),  (A2)  and  (A5)  we  obtain  for  all  e  >  0 

.max  |Vi|' 

—  \n€[ni,,nk4.t)  /  ^  »€[*»»  ,n»+,l 


< 


nt+i  <  00 


i=l 


for  some  ci ,  C]  >  0.  A  Borel-Cantelli  argument  yields 

lim  max  m|e“*  =  0  a.s. 

t-»oo  n€[nk,nk.«.i] 

Now  to  estimate  Vj  set 


/<  =  (d>i+ii  -  7(A)  V>t)  • 


Then 


i>0  t=t  i<0  (=1 

=  Vs  +  V,. 

We  restrict  ourselves  to  show  that  ^lim  e'^Vs  =  0  a.s.,  the  proof  for  e'^V^  is 
similar.  We  have 

V,  =  E  ^?-.-E/<  E^?+  E  E  E  E 

i>n  1=1—1*  On  1=1  l<«<n  1=1— i  l=n— i+1 


Vs -Ve-t-Vr-Va. 
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We  reatrict  ouiaelves  to  show  that  lim  e~^  V7  =  0  a.s.,  the  proof  for  V^,  and 
Vg  is  analogous.  Again  by  (Al),  (A2)  and  (A5)  we  have 

^E\ellV-,\*>^  <c^eliY,\fi\*'^  N  <  00 

ksl  tsl  i>0 

and  a  Borel-Cantelli  argument  yields  the  desired  result.  Similar  arguments  show 
that 

«« ’  iz  = ^ni  iz 

tsl  1=1 

So  we  obtain  as  in  (8.3)  that 

7n,,x(h)  -  y(h)  -►  0  a.s.  □ 

A  result  similar  to  Proposition  2  for  Z\  £  DA{p)  was  obtained  by  Bhansali 
(1988).  The  following  example  shows  that  Proposition  2  is  in  general  not  valid 
if  the  subsequence  (ng)  is  replaced  by  (n). 

EtampU.  Consider  the  MA(l)  process 

Xt  =  Zt  +  $ Zt~i ,  t  €  Af ,  1^1  <  1 , 

for  a  symmetric  Zi  €  DNA{a)  for  some  a  £  (0,2).  Then  as  mentioned  in  Sec¬ 
tion  2  (A1)-(A4)  and  (A5)  are  satisfied  where  (e„)  can  be  chosen  as 

e„  =  n‘/-(loglogn)^‘-“'*>'"  . 

Now  consider 

n— I 

J2iZt+9Zt.i){z,^i+ezt) 

tsl _ 

n 

X)(^i+tfz,_i)’ 

tsl 

5Z  Et  Zt+i  -f  9  Zf_i  Zt+i  -b  9  Zf  Zt-i  Zt 

t=i _ «=i _ t=i _ «=i _ 

ft  w  n  • 

Zf  +  9^Y1  ^t-i  +  ^9^^ Z,_i  Z, 

1=1  1=1  »=i 


7».x(l) 
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Rosinski  and  Woyczynski  (1987)  have  shown  that  for  some  c  >  0 
P  {Zi  Zi>x)<e  I-*  (1  +  log+  X-*)  . 

Similar  arguments  as  in  the  proof  of  Heyde’s  SLLN  [see  Stout  (1974)]  and  the 
fact  that 

f;P(2,Z,>eJ)<oo 


imply  that 


n-l 


^  (^«  ^«+i  Zt  Zt-i  +  0Zt~i  Zt+i  '; 


lim 

n<^oo 


«=1 


1=1 


=  0  a.s. 


Thus 


7«.Jf(l)  = 


tf  +  o(l) 


/  Isl 


a.s. 


(AP.3) 


We  shall  show  that 


lim  sup  Z^ 

nx-^oo 


00  a.s 


Define 


/n-l 
/  «=1 

:=  >  C  n’/-}  ,  :=  Zj*  <  n»/“|  , 


(AP.4) 


then  for  every  c  >  0 
P 


i^’/t  Zf  >  c  i.o.^  >  P  (A„  n  B„  i.o.)  . 


Note  that  ^  P{^n)  =  oo  and  liminf  P(B„)  >  0.  Since  A„  and  {fli.Bz,  •  •  • ,  B„} 

n=l  f»— oo 

are  independent  for  each  n  >  1,  an  application  of  a  standard  Borel-Cantelli 
lemma  [e.g.  Petrov  (1975),  Lemma  5,  Section  IX.2]  yields  P(A„  n  B„  i.o.)  >  0, 
hence 
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P{An  Cl  Bn  i.o.)  =  1  which  implies  (AP.4).  From  (AP.3)  and  (AP.4)  wc  con¬ 
clude  that  for  almost  every  u  there  exists  a  subsequence  n'  =  n'(w)  such  that 


Hence  0  is  an  a.s.  limit  point  of  yn,x(l)-  ^ 

We  apply  the  above  Proposition  2  to  give  an  analogous  result  for  and 

finally  for  and  oj  (/?»). 

Lemma  3  Suppose  (^V<  (-^S).  Then  for  every  fixed 

6  >  0,  uniformly  for  fi  €  ^  and  for  6  =  0  and  fi  €  C 

<..iP)  “  A 

where  gt  and  ^  are  defined  as  in  Lemma  9.1. 

Proof.  It  follows  by  an  adaption  of  the  proof  of  Proposition  10.8.2  in  Brockwell 
and  Davis  (1991)  and  in  view  of  Proposition  2.  □ 

This  lemma  ?  id  an  adaption  of  the  proof  of  Theorem  10.8.1  of  Brockwell  and 
Davis  (1991)  imply  the  following  result. 

Theorem  4  Suppose  "  causal  invertible  ARMA(p,q)  process  and 

conditions  (Al),  (AS)  and  (AS)  hold.  Then 

-  00  and  cl{0n,)  -  rt,-^{0o)  ■  □ 
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